

EuropalscRes 
Patentamt 



European 
Patent Office 



Office europeen 
des brevets 



Bescheinigung Certificate 



Attestation 



Die angehefteten Unterla- 
gen stirnmen mit der 
ursprunglich eingereichten 
Fassung der auf dern nach- 
sten Blatt bezeichneten 
europaischen Patentanmel- 
dung (iberein. 



The attached documents 
are exact copies of the 
European patent application 
described on the following 
page, as originally filed. 



Les documents fixes a 
cette attestation sont 
conformes a la version 
initialement deposee de 
la demande de brevet 
europeen specifiee a la 
page suivante. 



Patentanmeldung Nr. Patent application No. Demande de brevet n° 

03078841.8 ✓ 



PRIORITY 
DOCUMENT 

SUBMITTED OR TRANSMITTED IN 
COMPLIANCE WITH RULE 17.1(a) OR (b) 



Der President des Europaischen Patentamts; 
Im Auftrag 

For the President of the European Patent Office 

Le President de I'Office europeen des brevets 
p.o. 



R C van Dijk 



EPA/EPO/OEB Form 1014.1 - 02.2000 7001014 




Europaisches 
Patentamt 



European 
Patent Office 



Office europeen 
des brevets 



Anmel dung Nr: 

Application no.: 03078841.8 



Anmel de tag: 

Date of filing: 08.12.03 
Date de d^pot: 



Demande no: 



Anmel der/Appl 1 cant( s)/Demandeur( s) : 

Koniiiklijke Philips Electronics N.V. 
Groenewouds eweg 1 
5621 BA Eindhoven 
PAYS-BAS 



Bezel chnung der Erf 1 ndung/Tl tl e of the 1 nvent1on/Tl tre de l 1 Invention: 
(Falls die Bezel chnung der Erflndung nlcht angegeben 1st, slehe Beschrel bung. 
If no title 1s shown please refer to the description. 
S1 aucun tltre n ! est 1nd1qu6 se ref erer a la description.) 

Holographic data storage 2 

In Anspruch genommene Pr1or1'at(en) / Priori ty( 1es) claimed /Priori t£(s) 
revend1qu£e( s) 

Staat/Tag/Aktenze1chen/State/Date/FHe no. /Pays/Da te/Nume>o de d£pot: 



Internationale Patentklasslf 1 katl on/International Patent Classification/ 
Classification Internationale des brevets: 

G11C13/00 

Am Anmel detag benannte Vertragstaaten/Contractlng states designated at date of 
fUlng/Etats contractants d£s1gn£es lors du d6pot: 

AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HU IE IT LU MC NL 
PT R0 SE SI SK TR LI 



03078841.8 

EPA/EP0/0EB Form 1014.2 - 01.2000 7001014 



2 



Q.DEC. 2003 17:16 PHILIPS CIP NL +31 40 2743409 

PHNL031472EPQ 



NO. 339 P. 7/18 
030 08.12.2003 17:15:56 



08.12.2003 



Holographic data storage 2 



Staggered data structure in holographic storage systems 
Introduction 

Form recording data in holographic datastorage systems, data bits organized in 
pages are formed by a 2 dimensional grid of bits (for example using a light modulator 

5 with a two dimensional array of individually addressable elements (often also 

referred to as pixels)), which are either on or off. Unlike conventional optical storage 
systems like CD and DVD, the use of run length limited codes is not pursued, not 
because of the fact that this in principle impossible, but due to practical reasons. In 
holographic systems, a 2-dimensional pixilated light modulator can be used to 

10 transmit portions of a so-called data beam resulting in an encoded data beam, which 
after interference with a reference beam can form a diffractive structure in a suitable 
storage medium. Since the pixels in these light modulators determine the date bits, 
and the system will be designed to be diffraction limited in order to achieve the 
highest density, datapages consist of individual dots (data bits). Also other types of 

15 light modulators (like reflective) can be used. 



Problem 

Consider the figures below. Drawn on top is a conventional structure of data pages. 
This is not the most efficient way to make use of the available area in the medium 
20 and hence could results in a too low bitdensity. 

Solution and some embodiments 

It is proposed to use a staggered data structure (as shown at the bottom in below 
picture) that can increase the data density by roughly 40%. without adding too much 
25 complexity to the system. Lines connecting nearest neighbour data bits have an 

angle of approximately 45 degrees with the edges of the data structure or data page. 

The basic difference is that due to a more closed packing more bits can be stored in 
the same area, whereas the distance between the individual data bits is still 
30 reasonably large to avoid overlap, 
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To realize such a system, a data encoder having encoder elements for encoding a 
data beam (for example a 2 dimensional light modulator) needs to have a similar 
staggered structure, which doesn't actually pose any severe technical properties. On 
the other hand a pixelated photo-detector having detector elements organized in a 
staggered structure needs to be used. A device like this is already on the market and 
being used in digital camera's (like FUJI Finepix CCD-series). For reference we have 
included a picture of such a detector. 



» conusnnoftflL cod 



• super ccp 





In conclusion, the proposed method can lead to a significant increase of the 
attainable data density in a practical system, or one can use this enhancement to 
reduce the size of the components needed. 
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CLAIMS: 



1 . A holographic data storage system for reading and/or recording data bits 
being organized in a staggered data structure. 

2. A holographic data storage device for reading from and/or recording data 
pages in a holographic data storage medium, said device comprising a 
pixelated detector and a data encoder for generating an encoded data beam, 
said data encoder having individual encoder elements organized in a 
staggered structure. 

3. A holographic data storage device for reading from and/or recording data 
pages in a holographic data storage medium, said device comprising a 
pixelated detector and a data encoder for generating an encoded data beam, 
said pixelated detector having individual detector elements organized in a 
staggered structure. 

4. A holographic data storage medium comprising datapages having individual 
data bits organized in a staggered data structure. 



8. DEC. 2003 I?: 17 PHILIPS CIP NL +3i 40 2743489 

PHNL03 1 472EPQ 



NO. 339 P. 10/18 
033 08.12.2003 17:1 



08.12.2003 



10 



Phase-Retrieval in Volumetric 
Holographic Data Storage 

Wim Coene and Sjoerd Stallinga 
20-11-2003 



Abstract 

In the recording step for irtate-of-thc-art holographic datastorage, the wavefronts 
are modulated in amplitude only by the spatial light modulator (SLM) in ac- 

15 cordaucc with the 2D bit-pattern of the considered data page to be stored. The 

detection process on the COD for the reconstruction stop in holographic data 
storage is not sensitive to tho phase of the wavefront after the SIM, We propose 
an adapted hardware set-up for the reconstruction step which enables phase- 
retrieval of the wayefront behind tho SIM, This makes it possible to store two 
data pages instead of one per (angular or shift) multiplexing setting. Although 
this principle 3* in general possible for other multiplexing methods, we have de- 
scribed it in more detail for the case of angle-multiplexins, Two methods for 

20 phase-retrieval are proposed; (X) holographic restoration with an extra reference 

wavefront; and (2) a phase-stepping procedure. 

1 The Problem 

In state-of-the-art holographic storage (with angle-multiplesdng used as an ex- 
ample), the imago captured on the CCD reflects the (squared) amplitude distri- 
25 button of the wavefront for the data page that was present on the spatial light 
modulator (SIM) during the recording phase. Note that tho holographic record- 
ing also stores the phase information of the wavefront behind the SLM into the 
holographic medium (we will call this wavefront shortly the "SIM wavefront")* 
However, during recording at the CCD, this phase information is lost. Therefore* 
in the current stat^of-thc-art, the SLM wavefront is only meaningfully modulated 
in amplitude, not iu phase. 

30 
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2 The Current Idea in a Nut-Shell 

The current idea is to extend the reconstruction procedure in holographic storage 
$o that also the phase-information of the SLM wavefront can be restored. This 
doubles the information density that can be restored with one angle (or multi- 
plexing setting) as used in the reconstruction with angle-nxultiplexing. We will 
address two ways of phase-retrieval: 

• phase-retrieval through an extra holographic restoration setr-up added to the 
reconstruction procedure; 

♦ phase-retrieval through a phase-stepping procedure. 



3 Prior Art: Holographic Data Storage 
3.1 Holographic Recording of a Data Page 
15 The recording procedure for a single data page is shown in Fig. 1 (see also Fig.l 
in [Ij). The laser beam is split into two parts by a (non-polarizing) beam-splitter 
(NFBS). On top, we have the so-called "signal arm" where the wavefront passes 
through a spatial light modulator (SLM) (o.g. an LCD) where typically the am- 
plitude of the SLM pixels is modulated in correspondence with tho bits of the 
data page that is currently to be $tored, yielding the SLM wavefront denoted 
^ 3LM . At the bottom, we have the so-called "reference arm' 7 , where the wave- 
front passes through a grating yielding a reference wavefront denoted */W (which 

20 

is a plane wave eKp{27riK - r} with a wave vector K that can be tuned by tho 
grating). The two wavefronts of the signal arm and the reference arm intorforo in 
the holographic medium: the position-dependent part of the dielectric constant in 
the medium e(r) is then proportional to hfeua*+**/| a - For recording of multiple 
data pages, the wave vector is sot by the grating at for the jf-th page; with 
the SLM wavefront for the J-th page denoted i^ S lw tbo position dependent part 
of the dielectric constant of the medium after recording of the multiple pages 
25 becomes proportional to: 

e(r) oc Ej + exp{2?ri K? - r}|* . (1) 

3,2 Holographic Reconstruction of a Data Page 

The reconstruction procedure for a data page is shown in Pig T 2. This is called 
the "probe arm" in [1]. A wavefront is passed through a grating that is tunod 
to generate a plane wave with the proper wave vector K J for the reconstruction 
30 of the i-th data page. The latter wave is denoted and must bo equal to 
the reference wave that was used to record the data page. Tho wave propagates 
through the holographic medium where it is diffracted: it generates behind the 
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grating | 



Figure I: Prior Art. Recording step for one data page of information in holo- 
graphic storage* (with asgle-multiplexing). 



20 medium a wavefront that equals the SLM wavefront that was realized for the 
,?-th data page during tho recording of the data page. The SLM wavefront is 
imaged onto a CCD array, where the modulus squared of the wavefront \%1>L wi a 
is detected. { * SLm 
Note that instead of the SLM wavofront itself it is also possible to record the 2D 
Fourier transform of the wavefront into the holographic memory (the so-called 
":Fburier-plaixe" set-up). Our idea applies to both architectures. 

25 

4 New Idea 

4-1 Phase-Retrieval through Holographic Restoration 
4.1,1 Hardware Set-Up 

We propose a new reconsfeicrtioa procedure as shown in. Pig. 3. There is a (npn- 
polatf sing) beam splitter (NBPS) yielding two separate light paths with mutually 
30 coherent wavefronts. Note that the bottom path is identical to tho "probe arm" 
of the state-of-the-art reconstruction of Fig. 2 (apart from the registration on 
the COD): thus, it reproduces the SLM wavefront *j> 3hM behind the holographic 
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Figure 2: Prior Art, Roconstruction step for one data page of information in 
holographic storage (with angle-midtiplexing). 

medium- In addition, the current idea comprises m cartra light path, drawn at 
the top of Pig. 3. This top light path produces a wavefront that passes through 
another grating (called "grating-B ,J ) that yields a plane wave with a wave vector 
denoted Kjwrf, The resulting (plane) wavefront is denoted it> hpi . The wave vector 
Khoi is not at all related to that of the reference wavefront <fi re f needed for the 
holographic reconstruction. The choices that determine K hoJ will be discussed 
later in relation to the required post-processing of the CCD image. Next, the 
wavefronts of the two branches, that te 3 $slm and are made to interfere 
before registration on the CCD. Now, contrary to the state-of-the-art , the GCD 
records the power in the resulting wave£ront> that is: Iccd = \i>hoi+i>$LM | a * Note 
that this step as such fe not new on its own, since it i$ a well known technique in for 
instance phase-retrieval for off-axis electron holography [2], It is the combination 
of this holographic phase-retrieval, with holographic data storage that we claim 
as new insight, 

4.1.2 Post-Processing on CCD Image 

The different signal processing steps that are to be carried out on the CCD image 
are described in Fig. 4. First, for the reconstruction of the j-th data page, we 
rewrite the wayefront that is incident on the CCD as (with R the 2D position 
coordinate in the piano of SLM and CCD): 

= 4lm(H) + Gxp{27riK hol - K} exp{ic£}. (2) 
In the above equation, <f> represents a constant overall phase-difference between 
the two interfering wavefironts; for instance, it might be due to non-equal distances 
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Figure 3: Current ID- Set-up for reconstruction with phase-retrieval of one data 
page of information in holographic storage (with anglc-mtdtiplexing). 

for the two light-paths of Fig. 3. The image intensity recorded on the CCD then 
becomes: 



25 



30 



+ ^at( r ) CH£p{-2iriKh*.i • B-} exp{-i<6} 



(3) 



The first post-processing step comprises a 2D FFT (real-to-complex) in the "for- 
ward" direction applied on IcodQ&)- This yields formally (with SI tho 2D fre- 
quency vector in the 2D Fourier plane): 



= CB(0) + SB+(fl) + SB-(fl) 



(4) 



where CB stands for Omiral Band and SB for Side Band in the Fourier transform 
of tho CCD image. The central hand corresponds with the Iburior transform 
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of the first two terms in Eq. (3): it contain the auto-correlation of the SLM 
wavefront {which equals tho ODD imago intensity in the state-of-the-art solution). 
The sidebands SB+ and SET correspond to the Fourier transform of the third 
and fourth toons in Eq. (3), Due to the auto-correlation, the band-width of the 
central hand is twice as largo as the band-width of each of the sidebands. The 
magnitude of tho wave vector Khoi is chosen such that in the Fourier spectrum 
the sidebands and central band do not overlap. The aaimuth of the wave vector 
10 jXj^j can be chosen freely: in Fig. 4 it is chosen such that the sidebands are 
positioned along the horizontal axis in the Fourier spectrum* which corresponds 
to a fringe-pattern recorded on the OOD with a vertical orientation of tho fringes. 
But other choices are possible, for instanco diagonally oriented fringes leading to 
sidebands in opposite corners along one of the diagonals in the 2D Fourier plane. 
Further note that both sidebands are each other's complex conjugate, as must 
be, since they originate from a Fourier transform applied on a real- valued image. 
In other words, both sidebands carry exactly the same information. 
Tho second post-processing step comprises a selection of one of the sidebands (say 
SB + ), and centering operation with respect to its center point, which is equal to 

SB+(f2 - K hol ) - fctfCO). (5) 

Note that the information in the central band is not used at all. The third and 
last post-processing stop comprises a 2D Fourier transform (complex-to-complex, 
20 and in the "backward 1 ' direction, from f! to R), yielding the complex-valued 
wavefront ^slmO^) 

tizatte) = FT M {SB+(0 - Km)}. (6) 
Eq, (6) yields both amplitudo and phase information of the SLM wave&ont for 
ttoe j-tb data page that is stored in the holographic memory. 

25 4.1.3 Requirements put on the COD Sensor 

The resolution of tfce COD must be high enough to be able to record the informa- 
tion that is present in the sidebands. Since tho statQ-of-tho-art recording on tho 
CCD only records the central band, and since the bandwidth of the central band 
is twice that of the sideband, the current ID needs a COD with pixels that are 
twice as narrow as for the state-of-the-art solution. Note that this extra resolution 
is only needed in the direction that is orthogonal to the firinges (e.g. the horizontal 

30 direction as is shown in Fig, 4). A solution could be to use rectangularly shaped 
pixels on the CCD, with a horizontal to vertical aspect ratio of a factor two. 
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Figure 4: Current ID. Successive steps in post-processing on CCD-imago for holo- 
graphic reconstruction with phase-retrieval of one data page, (a) 2D forward FFT; 
(b) selection of side-band (c) 2D backward FFT. 

4.1.4 Use of the Central Baud 

As described above, in the holographic restoration, the central band information 
•is discarded, A method to use that information as 3ide-mformation is proposed 
in [3] fox the case of off-axfe electron holography. It comprises a signal processing 
step where the auto-correlation can yield additional information on the amplitude 
of the SLM wavefront. This might bo beneficial for cases of low signal-to-noise 
ratios. 

41.5 Variations on the Theme 

Other related details that came up are; 

• use of a CCD with square pixels, and detection of more than one page on a single 
COD image, where the different pages must have different wave vectors in 
the holographic restoration. In this case> the central bands are superimposed and 
are more difficult to be used in the post-processing. 

• other phase-retrieval methods are also possible, like detection of a series of CCD 
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images for the same dats^-page but at different settings of an optical parameter 
(like defocus or 2-fold astigmatism). Such methods are well known in the area of 
phase-retrieval for high resolution transmission electron microscopy (HR-TEM) 

w- 

4.2 Phase-Retrieval through a Phase-Stepping Procedure 
A different method of phase retrieval (that we propose in this ID) usee the method 
l ^ of phase stepping. Such methods are well-known in the field of interferometry 
[SJ. Now the additional wavefront ip h oi is uniform, i.e. we select 0. The 

resulting intensity measured on the COD is then: 

4od(B) « 1 + |^Ur(tt)J* + 2IVi XtM (H)|co S t0si M (R)--*] > (7) 

whore fgitf (R) is the phase of the wavefront ^Mf(R) that is to be reconstructed. 

15 This phase oan be retrieved by a phase stepping procedure. In thia procedure the 
phase <p of is Set to different values in a controlled w&y, and I$ GD {R) is 
measured for each phase value The phase of the reconstructed wavefront can 
be determined froin the measured values /^(H). The phase $ of can be 
varied by changing the optical path length of the arm of the w&vefcont hy 
e.g. displacing a mirror in this arm with a pioso-olement. 

For example, consider the ease where the SLM sets the phage <Pq&m&) 

of) equal to 0 or *r, This binary phase front caja be retrieved by stepping through two 
phases <j> x and 0», where ^ # (21 -f- l)*r/2 (I = 0, 1, 2, 3, . . -) and At - <fe « rr. In 
that cage the difference between the two measured intensity distributions yields: 

4^(R.)-4cd(R) = 4|4 £K (R)|cos[^m(H)-^] 

+4|^Slm(R)|cos(<0i), if ^sztm(R-) « O, , g . 
-4|#^(R)icos(^), if^M(R)-^ w 

25 It follows that the sign of the intensity difference determines the value of tho 
sought-for phase $ sim (ft) (which is assumed to be binary in this simple example) . 
Phase stepping methods requiring 4 to 3 stops are generally sufficient to retrieve 
an arbitrary (non-binary) phase front [3], 



30 



{ 



8. DEC- 2003 17=20 PHILIPS CIP NL +31 40 2743489 

PHNL031472EPQ 



NO. 339 P. 18/19 
041 08.12,2003 17 



12 G8J2.2003 



References 

[1] G. Barbastathfc aj\d D. Psaltfe, Volume JJaiogr&.pijc Miiltiplexing Meth- 
ods, in "Holographic Data Storage", Springer Series in Optical Sciences 
(ccfa, H.X Coufai, P. P&altis, G,T, Sincerboa:), 2000, pp. 21-61, 

[2] H, Lichte, Adv. Opt. Electa Microsc. Vol 12 (1991), p, 25. 

10 [3] W. Coene, "Method for Image Reconstruction in a High-Resolution Elec- 

tron Microscope", US-patent US5432347, 1995, 

[4] Special Issue of Ultramicroscopy on Brite-Euram Project No. 3322, "To- 
wards One- Angstrom Resolution", Ultr&micro$copy, Vol. 64, 1996. 



[5] Optica} Shop Testing, D, Malacara, ed. , John Wiley & Sons, New York, 
1992. 



15 



9 



PCT/IB2004/003916 



